huSync : a model and system for the measure of synchronization in small groups : a case study on musical joint action

Human communication entails subtle non-verbal modes of expression, which can be analyzed quantitatively using computational approaches and thus support human sciences. In this paper we present huSync, a computational framework and system that utilizes trajectory information extracted using pose estimation algorithms from video sequences to quantify synchronization between individuals in small groups. The system is exploited to study interpersonal coordination in musical ensembles. Musicians communicate with each other through sounds and gestures, providing nonverbal cues that regulate interpersonal coordination. huSync was applied to recordings of concert performances by a professional instrumental ensemble playing two musical pieces. We examined effects of different aspects of musical structure (texture and phrase position) on interpersonal synchronization, which was quantified by computing phase locking values of head motion for all possible within-group pairs. Results indicate that interpersonal coupling was stronger for polyphonic textures (ambiguous leadership) than homophonic textures (clear melodic leader), and this difference was greater in early portions of phrases than endings (where coordination demands are highest). Results were cross-validated against an analysis of audio features, showing links between phase locking values and event density. This research produced a system, huSync, that can quantify synchronization in small groups and is sensitive to dynamic modulations of interpersonal coupling related to ambiguity in leadership and coordination demands, in standard video recordings of naturalistic human group interaction. huSync enabled a better understanding of the relationship between interpersonal coupling and musical structure, thus enhancing collaborations between human and computer scientists

Exploring older adult needs and preferences for technology-assisted group music-making. A qualitative analysis of data collected during the participatory user-centred design process

Purpose: Engagement with arts, recreation and leisure is highly valued by older adults, with positive links to their continued wellbeing. Despite an availability of new music technology, these devices are rarely designed with older adults in mind. This project explores the needs and preferences of older adults in residential care as they interact with digital music interfaces in a group music-making context. Materials and methods: Twenty participants at an Australian residential aged-care facility were involved in a user-centred design process (20 sessions across six months) to develop digital music interfaces suitable for group music-making. Participants’ verbal comments were audio-recorded and transcribed, supported by further written observation notes made by the activity facilitators. Results: A hybrid inductive and deductive approach to thematic analysis revealed three main themes: individual music-making, ensemble music-making and social engagement. Our results suggest that when interfaces are designed with older adults in mind, technology-assisted group music-making can facilitate bringing together residents with different experiences and abilities. Conclusions: These findings suggest implications for rehabilitation in developing a range of musical devices for older adults to account for required flexibility, whilst maintaining an appropriate and satisfyingly “rich” musical outcome